INFINITE-DIMENSIONAL QUADRATURE AND QUANTIZATION 



STEFFEN DEREICH, THOMAS MULLER-GRONBACH, AND KLAUS RITTER 

Abstract. We study numerical integration of Lipschitz functional on a Banach space 
by means of deterministic and randomized (Monte Carlo) algorithms. This quadrature 
problem is shown to be closely related to the problem of quantization of the underlying 
probability measure. In addition to the general setting we analyze in particular integra- 
tion w.r.t. Gaussian measures and distributions of diffusion processes. We derive lower 
bounds for the worst case error of every algorithm in terms of its computational cost, and 
we present matching upper bounds, up to logarithms, and corresponding almost optimal 
algorithms. As auxiliary results we determine the asymptotic behaviour of quantization 
p^j ■ numbers and Kolmogorov widths for diffusion processes. 
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1. Introduction 

Let [i be a Borel probability measure on a Banach space (X, || • ||) such that 

\x\ fi(dx) < oo. 

Jx 

Moreover, let F denote the class of all 



> 
O 

Moreover, let F denote the class of all Lipschitz continuous functionals / : X — > R with 
Lipschitz constant at most one, i.e., 



\f(x)-f(y)\<\\x-y\\, x,yeX. 

We wish to compute 

S(f)= [ f(x)ii(dx) 



X 



O 
O 

for / G F by means of deterministic or randomized (Monte Carlo) algorithms that use 
the values f(x) of the functional / at a finite number of sequentially (adaptively) chosen 
^ points x G X. We present a worst case analysis, and we optimally relate the error and the 

cost of algorithms. 

The classical instance of this quadrature problem is given by X = M. d and [i being the 
uniform distribution on [0, l] d , say, or the <i-dimensional standard normal distribution. See, 
e.g., Novak (1988) and Wasilkowski, Wozniakowski (2001) for results and references. We 
are mainly interested in infinite-dimensional spaces X, and in particular we study Gaussian 
measures \x and distributions \x of diffusion processes, see also Wasilkowski, Wozniakowski 
(1996) and Pages, Printems (2004). Infinite-dimensional quadrature is applied, e.g., in 
mathematical finance and quantum physics, and moreover it is used as a computational 
tool to solve parabolic or elliptic partial differential equations. 

The appropriate framework for the analysis of finite- and infinite-dimensional quadra- 
ture problems is provided by the real-number model of computation. Informally, a real- 
number algorithm is like a C-program that carries out exact computations with real 
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numbers. Furthermore, a perfect generator for random numbers from [0, 1] is available, 
and algorithms have access to the functionals / G F via an oracle (subroutine) that pro- 
vides values f(x) for points x from a finite-dimensional subspace X C X. The subspace 
may be chosen arbitrarily, but it is fixed for a specific algorithm. If, for instance, fi is 
the Wiener measure on X = C([0, 1]) or, more generally, the distribution of a diffusion 
process, then spaces X of piecewise linear functions are frequently used in computational 
practice. The cost of an oracle call for f(x) is given by the dimension of the corresponding 
subspace Xq, while real number operations, evaluations of elementary functions, and calls 
of the random number generator are performed at cost one. Furthermore, in the case of 
a diffusion process, function values of its drift and diffusion coefficients are provided at 
cost one, too. 

By ejf 1 and e™ n we denote the smallest worst case error that can be achieved by any 
deterministic or randomized algorithm, resp., whose computational cost is bounded by N. 
We wish to determine the asymptotic behaviour of the minimal errors ejf 1 and e™ n and to 
find algorithms with cost close to N and error close to the corresponding minimal error. 
We write a N ^ b N for sequences of positive real numbers and b^ if supjv eN /b^ < oo. 
Moreover, x bjy means -< b^ and b^ -< a^. 

Our main results are the following upper and lower bounds for the minimal errors in 
the diffusion case and in the Gaussian case. 

Suppose that p, is the distribution of an m-dimensional diffusion process on the space 
X = C([0, 1], M m ), equipped with the supremum norm. Under mild assumptions on the 
drift and diffusion coefficients the minimal errors effi and e™ n satisfy 

4 et y (lniV)- 1/2 

see Theorem^ and Proposition and 

iV- 1/4 • (In A0" 3/4 ± eT 1 N~ 1/A ■ (In iV) 1/4 , 

see Theorems E] and 

We conclude that the quadrature problem for diffusion processes is intractable by means 
of deterministic algorithms, since (IniV)- 1 / 2 tends to zero too slowly, but randomization 
helps substantially. The upper bound for e™ n is achieved by a suitably adjusted weak 
Euler scheme. In view of the lower bound, this algorithm is optimal, up to a multiple of 
at most In N, in the class of all randomized algorithms. 

Suppose that \x is a zero mean Gaussian measure on a separable Banach space X, whose 
small ball function 

<p(e) = —lri[i({x e X : \\x\\ < e}) 

satisfies 

<p(e) x e- a ■ (lne-y 

for some constants a > and £ Rase tends to zero. This asymptotic behaviour typically 
holds for Gaussian measures on infinite-dimensional spaces, see, e.g., the review article 
by Li, Shao (2001). Consider, for instance, the distribution fi of the fractional Brownian 
motion with Hurst parameter H G ]0, 1[ on the space X = C([0, 1]) or X = L p ([0, 1]) 
with p G [1, oof. Then a — 1/H and (3 = 0. A non-zero constant (3 appears, for example, 
in case of [i being the distribution of the d- dimensional Brownian sheet on the space 
X = L 2 ([0, l} d ). Then a = 2 and (3 = 2(d - 1), see Csaki (1984) and Fill, Torcaso (2004). 
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Given the above small ball asymptotics, the minimal error ejf' satisfies 

4 et y {\nN)~ 1/a ■ (lnlniV)^ a , 
see Theorem ^ and Proposition El Furthermore, for the minimal error e™ n we have 

£ ran -< N~ 1/{2+a) ■ (m iV) (a+/3)/(2+a) , 

see Theorem as well as 

limsup e% n ■ N 1 '^ ■ (i n ]v)( 2 + 2 «-^)/M 2 +«)) . (l n lniVr 2/3/(a(2+a)) > 0, 

7V->oo 

see Theorem El Note that the bounds for e™ n only differ by powers of In N and In In N 
for an infinite sequence of integers N. 

We observe intractability of the quadrature problem for Gaussian measures by means 
of deterministic methods, and randomization helps substantially. The upper bound for 
£™ n is achieved by the classical Monte Carlo algorithm based on a normal distribution on 
a properly chosen subspace X C X. 

We briefly outline the content of the paper. For the analysis of the quadrature problem 
we establish general relations of the minimal errors sffi and e™ n to quantization numbers 
and average Kolmogorov and linear widths of probability measures on Banach spaces. 
See, e.g., Creutzig (2002), Dereich (2003), Dereich et al. (2003), Graf, Luschgy (2000), 
Luschgy, Pages (2004), and Ritter (2000) for results and references concerning the latter 
quantities. 

In Section E] we only use the fact that algorithms evaluate the functionals / e F at a 
finite number of points i6l The minimal errors e^ et and e™ n are defined as the smallest 
worst case error that can be achieved by any algorithm that uses n functional evaluations 
(on average). These minimal errors turn out to be closely related to the quantization 
numbers q4 , which are defined as a distance of the measure /i to the class of all discrete 
probability measure on X with support of size n. More precisely, we have 



e det = (1) 



see Theorem ^ and 



n 1/2 - sup(e i -g«)^er^n-^.^) /2j: 

m>4n 



see Theorems 121 and El The latter estimate yields the well-known result e™ x rr 1 l 2 ~ 1 l d 
in the finite-dimensional case X = M. d . 

In Section El we examine the computational cost of algorithms more closely, and we 
take into account that the functionals / G F may only be evaluated at points x from 
finite-dimensional subspaces Xq C X. The latter restriction leads to the consideration of 
average Kolmogorov widths of the measure /x, which are defined as average errors of 
best approximation by means of optimally chosen fc-dimensional subspaces Xo C X. It 
turns out that 

^ an > inf max(er,4 1) ) 

k-n<N 

for every measure /i, see Proposition |21 which is the key tool to derive the lower bounds 
for randomized algorithms.. 

In Sections |U and El we study diffusion processes and Gaussian measures, resp., and we 
apply the general results from Sections El and El As auxiliary results we determine the 
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asymptotic behaviour of the quantization numbers and the Kolmogorov widths in the 
diffusion case, see Proposition El and Remark 

2. Quadrature of Lipschitz Functionals and Quantization 

At first we disregard the details of the real number model. We only take into account 
that algorithms may only evaluate the functionals / G F at a finite number of sequentially 
chosen points in the Banach space X in order to approximate the integrals S(f). 

2.1. Basic Definitions. Any deterministic sequential evaluation is formally defined by 
a point 

Xi G I 

and a sequence of mappings 

i> t : M^ 1 -> X, £>2. 

For every / G F the evaluation starts at the point x\, and the mappings ipi determine 
the subsequent evaluation points. More precisely, after n steps the functional values 

2/i = f&i) 

and 

Ve = f(Mvu • • • , yt-i)), £ = 2,...,n, 
are known. A decision to stop or to further evaluate / is made after each step. This is 
formally described by a sequence of mappings 

r £ :M £ ^{0,l}, £>1, 

and the total number n(f) of evaluations is given by 

n(f) = min{£ > 1 : n{y x , ...,y £ ) = l}, 

which is finite for every / G F by assumption. Finally, an approximation 

S(f) = (j) n (f)(yi,---,y n (f)) 

to S(f) is defined by a sequence of mappings 

<f>l : R e -> R, £>1. 

Any such mapping S : F — > M could be considered as a deterministic algorithm, with 
algorithm being understood in a broad sense, and the corresponding class of mappings is 
denoted by § det . For convenience, we identify S with the point x\ and the sequences of 
mappings ip£, Tg, and <fig. Moreover, we write card(5*, /) instead of n(f), and this quantity is 
called the cardinality of S applied to /. Note that § det contains in particular all quadrature 
formulas 

n 

s(f) = ^2 a i- f( x i) 
i=i 

with cij G M and Xj G X. Here all mappings tpt and are constant with ip 2 — %2, ■ ■ ■ , — 
x n and T\ = ■ ■ ■ = T n _i = while r n = 1, i.e., all functionals / G F are evaluated 
non-sequentially at the same set of n points, and 4> n is linear. 

A randomized (or Monte Carlo) broad sense algorithm based on sequential evaluation 
is formally defined by a probability space (0, 21, P) and a mapping 
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such that 

(i) S(u>, ■) G § dct for every cu G Cl, 

(ii) S(-, f) is measurable for every / G F, 

(iii) us i — card(S , (co', •), /) is measurable for every / G F. 

We refer to Nemirovsky, Yudin (1983) and Wasilkowski (1989) for this and an equivalent 
definition of randomized algorithms. In the sequel the random variables from (ii) and (iii) 
are denoted by S(f) and card(S', /), respectively. 

By S ran we denote the class of all mappings S with properties (i)-(iii) on any probability 
space. Clearly, § det C S ran . Note that § ran contains in particular the classical (abstract) 
Monte Carlo method 

n 

(1) S(f) = 1/n ■ f(Xi) 

i=i 

with X\, . . . , X n being independent and distributed according to ji. 
The worst case error of S G S ran is defined by 

e(£) = sup (E\S(f)-S(f)\ 2 ) 1/2 , 
feF v / 

which in particular for S G § det reads 

e(S) = sup\S(f)-S(f)\. 

The worst case cardinality of S G S ran is defined by 

card(S') = supE(card(5, /)), 
feF 

which in particular for S G S det reads 

card(5) = sup card(5*, /). 
feF 

For simplicity we assume that card(S') G N for randomized algorithms, too. 

Minimization of the worst case error among those broad sense algorithms that use at 
most n evaluations (on average) leads to the definition of the n-th minimal errors 

< an = inf {e(S) : S G § ran , card(S) < n} 

and 

e det = mf{e(S) : S G § dct , card(S) < n}. 

We add that minimal errors are key quantities in information-based complexity, see, e.g., 
Traub, Wasilkowski, Wozniakowski (1988), Novak (1988), and Ritter (2000). 

In Sections 12 .21 and 12.31 we relate the minimal errors to quantization numbers. The n-th 

(r) 

quantization number q\ of order r > is defined as 

;i r) = inf a {r) 

where 



q y n ' = ml q K '[x u ...,x r , 
ex 



l/r 

q( r \xi, . . . , x n ) — ( / min \\x — Xi\\ r fi(dx) 

see, e.g., Graf, Luschgy (2000). In this context a collection of points x%, . . . ,x n G Xis called 
a codebook for quantization of the probability measure \x. For notational convenience we 



6 



QUADRATURE AND QUANTIZATION 



let q n = qn and q = Note that q n < oo, and furthermore lim^oo q n = if X is 
separable. 

2.2. Deterministic Algorithms. The quantization problem and the quadrature prob- 
lem by means of broad sense deterministic algorithms are equivalent in the following sense. 
Since S is a real- valued linear mapping on a convex and symmetric set F, it follows that 

(2) e det = M{e(S) : S G § dot is a quadrature formula, card(S) < n}, 

see Smolyak (1965), Bakhvalov (1971), and also Traub, Wasilkowski, Wozniakowski (1988, 
Chap. 4.5). Furthermore, for F and S as studied in this paper we have 

inf{e(5) : S G § dot is a quadrature formula based on xi, . . . , x n } = q(x\, . . . , x n ) 

for every codebook Kantorovich, Rubinstein (1958) and Gray, Neuhoff, 

Shields (1975). The latter infimum is attained by the quadrature formula 

n 

(3) S(/) = X>M) '/(*<), 

8=1 

if Vi, . . . , is a corresponding Voronoi partition of X. An (almost) optimal codebook 
therefore yields an (almost) optimal quadrature formula 0, and the n-th minimal error 
e det coincides with the n-th quantization number of order one. 

Theorem 1. For every n G N 

e det = a 

Remark 1. There are numerous results on e det or q n for finite-dimensional spaces X = M. d , 
see, e.g., Novak (1988), Graf, Luschgy (2000), Wasilkowski, Wozniakowski (1996, 2001). 

Assume r > 1. Then, under rather mild assumptions on u, and in particular for the 
uniform distribution on [0, l] d , the quantization numbers satisfy 

(4) lim q^ ■ n 1 ^ = c (r) 

n— >oo 

with some constant = c^(p, d, \\ ■ ||) > 0, see Graf, Luschgy (2000, Thm. 6.2). 

Remark 2. Much less is known about e det or q n for infinite-dimensional spaces X, 
see Wasilkowski, Wozniakowski (1996), Dereich et al. (2003), Dereich (2003, 2004), and 
Luschgy, Pages (2003, 2004) for results and references. If u is the distribution of a diffusion 
process or a Gaussian process then, typically, the quantization numbers q^ tend to zero 
only with logarithmic order, see Sections H] and For such processes we conclude from 
Theorem^ that quadrature of arbitrary Lipschitz functionals by means of (broad sense) 
deterministic algorithms is intractable. 

As an example consider the Wiener measure « on X = C([0, 1]) endowed with the 
supremum norm. In this case 

(5) lim ■ (Inn) 1/2 = c 
with some constant c > 0, see Dereich, Scheutzow (2005). 
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2.3. Randomized Algorithms. Wc first state an upper bound for the minimal error 

(2) 

e£f n in terms of the quantization number g„ , which is a consequence of a well-known 
variance reduction technique based on quantization, see Pages, Printems (2004). Note that 
lim n ^oo q^f 1 = if X is separable and J x \\x\\ 2 fi(dx) < oo. Under the latter assumption the 
classical Monte Carlo method <$J$ without variance reduction only yields errors of order 
tt,- 1 / 2 in all non-trivial cases. 

Theorem 2. For every ngN 

Proof. Consider a codebook well as a corresponding Voronoi partition 

Vi, . . . , V n of X. For f E F let J(f) denote the interpolation of / at the points Xi that is 
constant on the corresponding cells Vi, i.e., 

n 
i=l 

The deterministic broad sense algorithm (JHJ) approximates S(f) by S(J(f)). Define a 
broad sense randomized algorithm S G S ran with card(S') < 2n by 

n 

(6) S(f) = S(J(f)) + l/n ■ £(/ - J(f))(Xi) 

i=i 

with Xx, . . . , X n being independent and distributed according to /i. Hence the non-deter- 
ministic part of S consists of applying the classical Monte Carlo method (fTf to / = 
f-J(f). It follows that 

e(S) = n- 1 ' 2 • sup U (f(x) - 2 fi(dx) 

Since \f(x)\ < minj =lv . jn \\x — Xi\\, we obtain 

f(x)-S(f))\(dxfj ' < (Jj 2 (x)fi(dx)^j ' + \S(f)\ 

< q {2) (x 1 , ...,x n ) + qW(xi, ...,x n ) 
<2-g (2) (xi,...,x n ), 

which completes the proof. □ 

We now turn to lower bounds for (broad sense) randomized algorithms. In this setting 
a result analogous to (0) is not available in general, and therefore considerations cannot a 
priori be restricted to randomized quadrature formulas. We use the following tool, which 
is due to Bakhvalov (1959) and Novak (1988) and which holds for integration problems 
in general, see Novak (1988, Sec. 2.2.10). 

Proposition 1. Let m > An, and suppose there are junctionals fx, . . . , f m : X — > R such 
that 





(7) 



{x e X : fi(x) ^ 0} n {x E X : fj(x) ^ 0} = 
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for all i 7^ j and 

m 

(8) -fiEF 

i=l 

for all S\, . . . , S m G {±1}- Then 

e r aa > l. n V2. min 
i=l,...,m 

A proper choice of the functionals /j in Proposition ^ yields a lower bound for the 
minimal error e^ an in terms of consecutive differences of quantization numbers. 

Theorem 3. For every ngN 

C n > | ■ n 1/2 ■ sup (g m _i - q m ). 

m>4n 

Proof. For e G ]0, 1[ and m > 4n choose xi, . . . , x m G X with 

(9) g(a?i, . . . , x m ) < e ■ q m -i + (l-e)-q m + £, 
and consider the functionals 

fi(x) = \ ■ max(0, min ||x — Xj\\ — \\x — Xi\\), i — 1, . . . ,m. 

Clearly ((7j) is satisfied and fi, . . . , f m G F. Consequently (jHJ) holds, too. 
We claim that 

(10) S(fi)> l -^-{q m -i-q m )-e. 

It suffices to prove the statement for i = m. To this end consider a Voronoi partition 
Vi, . . . ,V m corresponding to Xi, . . . , x m , and let Ui, . . . , U m _i be a Voronoi partition cor- 
responding to Xi, . . . , x m -i. If j < rn — 1 and x G V m n £/j then 

fm{%) 2 ' (11*^ II II *^m||) ■ 

Hence 

f m {x) fi{dx) = f m {x)fi{dx) 
■ Jv m 

m— 1 „ „ 

— | " yj / ||x — yu(dx) — | • / ||a; — x m || /x(g?x) 
, =1 Jv m nUj Jv m 

m— 1 „ m „ 

= 5'S/ II^-^IImW - 1 -yi / Hx-xjIIM^)- 

Note that the sets (Kn n Z7j) U V, with j < m — 1 form a partition of X as well, and every 
x G (Kn H C/j) U Vj satisfies 

min ||x — Xk\\ = \\x — Xj\\. 

fe=l,...,m— 1 

Thus 

S(f m ) = \ ■ (q(x 1 , . . .,x m _i) - q(x u . . .,x m )) 

and (HH follows from ©• 

It remains to apply Proposition ^ and to let e tend to zero. □ 
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The following consequence of Theorem E] is useful, in particular, for finite-dimensional 
spaces 3C. 

Corollary 1. If the sequence (g n )ngN is regularly varying with index —a < then 



liminf e™ n • n 1/2 /q n > 



a 



25+2a ' 

Proof. Put 

g(m) = sup 0_i - q t ) 

£>m 

for m G N \ {1} and let re > 1. Clearly, 

(/(m) > T = = g m • 



[«;m] — m J "" [rem] — m 
Since limm^oo q\ Km -\ jq m = re~ a it follows that 

1 — re~ Q 

liminf g(m) ■ m/q m > . 

m-»oo K — \ 

Letting re tend to one yields 

liminf g(m) ■ m/q m > a. 

m— >oo 

Combining the latter estimate and Theorem El completes the proof. □ 

Remark 3. Suppose that the quantization numbers satisfy which typically holds in 
the finite-dimensional case X = M. d , see Remark ^ Then Corollary ^ is applicable with 
a = 1/d, and we obtain 

liminf eT-n 1/2+1/d > , \^ liV 

A matching upper bound is provided by TheoremEl so that we end up with the well-known 
fact 

p ran ^ -1/2-1/d 

see Novak (1988, Sec. 2.2.6) for the case of the uniform distribution \i on [0, l] d . 

From the previous remark we conclude that, up to multiplicative constants, neither the 
upper bound in Theorem nor the lower bound in Theorem El can be improved in general. 

CorollaryQJis not applicable, if the quantization numbers are slowly varying, cf. Remark 
El Instead, one may use the following result. 

Corollary 2. Let f : [0, oo[ — > ]0, oo[ be a convex and differentiate function. If 

limsup q n /f(n) > 1 

n^oo 

and 

lim q n = 0, 

71— »OC 

then 

limsup e T ™/ (n 1/2 ■ \f\(4n + 3)) > 1/8. 

n— »oo 
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Proof. Fix e G ]0, 1[. By assumption 

POO 

Qm-i > (1 - e) ■ f{m - 1) = (1 - e) • / -f'(s) ds 

Jm-l 

holds for infinitely many integers m. Since q m -\ = YLkLmiQ*- 1 ~ we a ^ so nave 
q m -i ~ q m > (1 - e) • / -/'(*) da > "(1 - e) ■ f'{m) 

J TO— 1 

infinitely often. To every such m we associate n = [m/4j. Then m G [4n,4n + 3] and 
Theorem |3] implies 

e™ n > -(1 - e)/8 • n 1/2 • /'(4n + 3). 
Letting e tend to zero finishes the proof. □ 

Remark 4. Suppose that the quantization numbers satisfy 

gMx(lnn)- 1 / 2 , 

which typically holds for diffusion processes, see Proposition El and in particular for the 
Wiener measure, see Remark [21 Then Corollary |21 is applicable with fit) = c- (hit) -1 / 2 
for some constant c > 0, and we obtain 

(11) lim sup < an • n 1/2 • (In n) 3/2 > 0. 
On the other hand, 

(12) lim sup eJT • n 1/2 ■ (Inn) 1/2 < oo 

n^oo 

by Theorem |21 This upper bound is achieved by a sequence of comparatively simple broad 
sense randomized algorithms, see (JBJ), which are far superior to any sequence of (broad 
sense) deterministic algorithms, see Theorem ^ Moreover, upper and lower bounds do 
not differ much for an infinite sequence of integers n. We add that, for a large class 
of diffusion processes, inequality (fTTj) holds true with limes superior replaced by limes 
inferior, see Proposition 0] 

3. Finite-dimensional Sampling and Kolmogorov Widths 

So far we have studied broad sense algorithms S G S mn , and we have expressed the 
quality of such an algorithm in terms of its error e(S) and its cardinality card(S'). The 
cardinality serves as a crude measure of the cost of S, if one assumes that evaluation of 
functionals / G F is possible at any point x G X at cost one and if all further operations 
are not taken into account. Moreover, by definition of S ran , a broad sense randomized algo- 
rithm may use perfect generators for random elements according to any Borel probability 
measure on X, in particular according to \l. These assumptions are rather unrealistic and 
do not correspond to a reasonable model of computation, and the practical relevance of 
algorithms like © and upper bounds like (fT2|l seems to be doubtful. We stress that this 
point of view concerns lower bounds like (fTTj) only in the sense that they are 'too weak'. 

It is more appropriate to take the real number model of computation as a basis for 
quadrature problems. See Traub, Wasilkowski, Wozniakowski (1988) and Novak (1995) 
for the definition of this model. Informally, a real number algorithm is like a C-program 
that carries out exact computations with real numbers. Furthermore, a perfect generator 
for random numbers from [0, 1] as well as elementary functions like exp, In, etc. are 
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available. We think that these assumptions are present at least implicitly in most of the 
work dealing with quadrature problems. Algorithms have access to the functionals / e F 
via an oracle (subroutine) that provides values f(x) for points x from a finite-dimensional 
subspace Xo C X. The subspace may be chosen arbitrarily but it is fixed for a specific 
algorithm, and the cost for each oracle call is proportional to the dimension of Xo- 

Example 1. Consider the distribution p, of a diffusion process X with values in X = 
C([0, l],M m ). Let denote the Euler scheme with uniform step-size l/(k — 1) and 
piecewise linear interpolation, and define the classical Euler Monte Carlo algorithm Sn^ 
by 

n 

(13) S^\f) = l/n-J2f(W ) ) 

with independent copies X[ k \ . . . , X ( n ] of X( fc ). This algorithm uses an oracle for the k- 
dimensional subspace of piecewise linear functions with breakpoints at £/ (k—1). Moreover, 
only random numbers from [0, 1] are needed for the computation of Sn \f). 

For simplicity we assume that the cost of an oracle call for functional evaluation co- 
incides with the dimension k of the corresponding subspace X and that real number 
operations as well as calls of the random number generator and evaluations of elementary 
functions are performed at cost one. Furthermore, in case of p being the distribution of a 
diffusion process, function values of its drift and diffusion coefficients are provided at cost 
one, too. Then the total cost of a computation is given by k times the number of oracle 
calls for functional evaluation plus the total number of real number operations, calls of the 
random number generator, evaluations of elementary functions, and, eventually, function 
evaluations of drift and diffusion coefficients. 

For randomized algorithms S the computational cost is a random variable, which also 
may depend on the integrand / G F . Analogously to card(S') we therefore define cost (S), 
the worst case cost of S, by its maximal expected cost over the class F . 

Remark 5. For the classical Euler Monte Carlo algorithm we have 

cost(^ fc) ) x k ■ n, 

i.e., the cost is proportional to the product of the dimension of the subspace and the 
number of oracle calls for functional evaluation. Equivalently, the cost is proportional to 
the product of the number of time steps and the number of repetitions. 

Analogously to e™ n we introduce the iV-th minimal error 

£™ n = mi{e(S) : S randomized algorithm with cost (S) < N} 

in the real number model. By just counting the number of oracle calls we get e™ n > e™ n . To 
derive a lower bound for e™ n that also takes into account the dimension of the subspaces 
X we study the the k-ih average Kolmogorov width of order p > 

4 p) = inf | (^J dist p (a;, X ) nidxfj : dim(X ) = fc j 

for the measure \i. For notational convenience we let d k = See, e.g., Ritter (2000, 
Sec. VII. 2. 5) and Creutzig (2002) for results and references. 
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The following lower bound corresponds to the extremal cases, where either the dimen- 
sion k of the subspace or the number n of evaluations may be arbitrarily large. 

Proposition 2. For every N G N 

e r r > inf max(e^ an ,4). 

k-n<N 

Proof. Consider any randomized algorithm S with cost (S) < N, and assume that its 
oracle is based on a ^-dimensional subspace % C X. Define a functional fo G F by 
f = dist(-, Xq). Since S evaluates f only at points from X we have 



S(fo) = S(-f ), 



and consequently 



e(S) > | ■ (W(/o) - 5(/ )| 2 ) 1/2 + (e|5(-/ ) - 5(-/o)| 2 ) 1/2 ) > 5(/o). 

Hence 

e(S) > / dist(x, X ) fi(dx) > d^. 
Jx 

On the other hand, put n = card(S') to obtain 

e(S) > eT- 

We conclude that e(S) > max(e™, dk) for some k, n G N such that k ■ n < N. □ 

4. Randomized Algorithms for Diffusion Processes 

In this section we consider the distribution fi of an m-dimensional diffusion process X 
on the space C([0, 1], R m ), equipped with the supremum norm. More precisely, X is given 

dX t = a(X t )dt + b(X t )dW t , 
^ X = u e R m 

for t G [0, 1] with an m-dimensional Brownian motion W, and we assume that the following 
conditions are satisfied: 

(i) a : M. m —>■ M. m is Lipschitz continuous 

(ii) b : M. m — > M mxm has bounded first and second order partial derivatives and is of 
class C°° in some neighborhood of Uq 

(iii) det b(u ) ^ 

We first present bounds for the quantization numbers and the Kolmogorov widths, see 
also Remark [7| The corresponding proofs are postponed to Section |4~21 

Proposition 3. The quantization numbers qh satisfy 

gW x (Inn)" 1 / 2 

for every r > 0. The average Kolmogorov widths dfj^ satisfy 



4 p) x k- 1 ' 2 



for every p > 0. 
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The asymptotic behavior of the quantization numbers stated in Proposition |3] is par- 
tially known. Luschgy and Pages (2003) study scalar stochastic differential equations 
under suitable growth and smoothness conditions. In this work the upper bound is estab- 
lished for equations with a strictly positive diffusion coefficient b : [0, 1] x R — > R, and a 
matching lower bound is derived if inf^^g^ijxR b(t, x) > and r > 1. More generally, Tri- 
dimensional diffusions with a scalar diffusion coefficient b : [0, 1] x IR m — > R are analyzed 
by Dereich (2004), who determines the exact asymptotic behavior of the quantization 
numbers for r > 1 under rather mild smoothness assumptions.. The asymptotic behavior 
of the Kolmogorov widths is determined by Maiorov (1993) for the Brownian motion. 

Observing Theorem we conclude that quadrature of arbitrary Lipschitz functionals is 
intractable by means of deterministic algorithms. 

We next present a lower bound for the minimal error e^ an , which improves the estimate 
(fTTj) . See Section IPl for the corresponding proof. 

Proposition 4. The minimal errors e™ n satisfy 

eThn" 1 ' 2 -(Inn)- 3 / 2 . 

Propositions El El and 0] immediately yield the following lower bound. 

Theorem 4. The minimal errors s™ n satisfy 

eT h N- 1/4 ■ (lniV)- 3/4 . 

Consider the Euler Monte Carlo algorithm for equation (|14j) with normally dis- 
tributed increments. More precisely, put xf^ = uq and define 

X% = + - 1) ■ a(X«) + 1/Vk=l ■ b(X$) ■ Z i>e 

for i = l,...,n and i = 0, ...,k — 2. Here (Z^)^ is an independent family of Tri- 
dimensional standard normally distributed random vectors. Finally, let X^ k ' denote the 
piecewise linear interpolation of xffi, . . . ,X^_ X at the breakpoints ijik — 1). Then Sn 
is given by (fTT^ . 

Theorem 5. The Euler Monte Carlo algorithm S N = Sn with n = [N 1 / 2 ■ (IniV) -1 / 2 ] 
and h = [N 1 ' 2 ■ (In iV) 1/2 J satisfies 

e(S N ) 1 N^ 1 ^ ■ (lniV) 1//4 

and 

cost(SV) r< N. 

Proof. Consider the strong Euler scheme X^ with step-size l/(k — l) and piecewise linear 
interpolation for equation Then 

(15) E||X -X (fc) ||oo < ci • k~ 1/2 ■ (\nk) 1/2 

with some constant c\ > that does not depend on k, see Faure (1992). Let / e F. Since 
S(f) = E(f(X)) and E(S N (f)) = £(/(!«)), we get 

\S(f)-E(S N (f))\< Cl -(\nk/k) 1/2 

for the bias of SV(/) by means of ([T5|). Put g = f — f(0) to obtain 

V(&(/)) = Y(S N (g)) < 1/n • E(/(X( fc ))) < 1/n • E(||X« || 2 J < c 2 • 1/n 
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for the variance of Sw(f), where the constant c 2 > depends neither on k nor on /. We 
conclude that 

E(S(f) - S N (f)) 2 < max(c], c 2 ) • (1/n + In k/k) , 
and with the particular choice of n and k the asymptotic upper bound for the error of 
Sn = Sn follows. The cost of Sn is determined in Remark El □ 

Combine Theorems 0] and 03 to conclude that the Euler Monte Carlo algorithm Sn is 
almost optimal. 

Corollary 3. 

e(5,v)^ n -lniV. 

4.1. Preliminaries. A basic idea in the proofs of Propositions 01 and 0] is to reduce the 
the case of an m-dimensional diffusion process with properties (i)-(iii) to the particular 
case of a one-dimensional Brownian motion by means of Lipschitz transformations and 
stopping. 

Let X denote any random element with values in some Banach space X and consider 
its distribution /i on this space. We use the notation 

er(X,X)=er 

for the n-th minimal error of randomized algorithms, 

4 p) (*,x) = 4 p) 

for the k-th average Kolmogorov width of order p, and 

q£\X,X)=qM 

for the n-th quantization number of order r. 

Consider a measurable mapping T : X — > 2), where 2) is a Banach space, too. The 
following observation is straightforward to verify. We add that an analogous result for 
Kolmogorov widths is not available. 

Lemma 1. Suppose that T is Lipschitz continuous with a Lipschitz constant L > 0. Then 

eT{TX^)<L-eT{X,X) 

and 

qV(TX,iQ)<L.q<r\X,X). 

We formulate a simplified version of a general relation between quantization numbers 
and average Kolmogorov widths, which is due to Creutzig (2002, Thm. 4.6.1). 



Lemma 2. For < r < p 



sup Inn • q { ;\X, X) -< sup k ■ df{X, X). 

n<2 £ ' k<£ 

The following contraction principle holds for best approximation of sums of independent 
and symmetric random elements. 

Lemma 3. Let Xi, . . . , X^ denote a sequence of independent and symmetric random 
elements with values in X and let p > 1. Then 

k k 

E(dist p £0) ) < max^ \X e \ p ■ E(dist p (JT, X t , X ' 
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for all Ai, . . . , A*; G M and ever?/ closed linear subspace Xo C X. 

Proof. Take Rademacher variables £1, . . . , £& such that £1, . . . , e k , X\, . . . , X k are inde- 
pendent, and consider the quotient mapping Q : X — > X/X . Since (X 1; ...,X fc ) and 
(£iX 1; . . . , £fcX fc ) coincide in distribution, the same holds true for ((JXl, . . . , QX k ) and 
(£iQX 1; . . . , e k QX k ). Hence 



fc fc fc 



E(dist p (^A,X,,£ )) =E||^A £ -QX,||^ = ^£^\ t e t -QX l 
For any choice of elements ye G X/X 

E > \e€e ■ ye < max |AJ P -E> £^ • 

II f— ' X/X £=l,...,k' | If—' 



P 



£=1 £=1 



P 



due to Kahane's contraction principle, see Kahane (1993, p. 21). Thus 



k k 
P 



P 

X/Xo 



E V^£f ■ QXe < max |A^| P • E V e e ■ QX e 

£=1 £=1 

which completes the proof. □ 

Now we turn to the diffusion process X given by (|14p. 
Lemma 4. There exists a neighborhood U of uq and a function f G C°°(U) such that 

(Vfybb*wf = i. 

Proof. Choose a radius r > such that det bb*(u) ^ if \u — uq\ < r. Furthermore, take 
g G C ,00 (R m , R mxm ) with symmetric and positive definite values such that 

g(u) = (bb*)-\u) 

if \u — wo | < r/2 and g(u) is the identity matrix if \u — uq\ > r. Then M = M m endowed 
with the metric tensor YlTj=i 9ij ( u ) ' du % ® du? * s a complete C°°-Riemannian manifold. 
Here n 1 ,...,n m are the local coordinates obtained when taking the identity as chart. 
Moreover, let g?m denote the corresponding Riemannian distance. 

Choose v o G M such that < |^ — n | < r/2 and < dA/(t> ,no) < i V0 (M), where 
i V0 (M) denotes the injectivity radius at v , see Sakai (1996, Prop. III. 4. 13). Define 

U = {u G M : < |u - u\ < r/2, < d m (v ,u) < i VQ (M)} 

as well as 

f{u) = d M (v ,u) 

for u G U. Then / G C°°(U) and (V/)*66*V/ = 1, see Sakai (1996, Prop.. III.4.8). □ 

In addition to C = C([0, 1], M m ) we also consider the Banach space L\ = Li([0, 1], M. m ). 

Lemma 5. Either let X = C and 2) = C([0, 1],R) or let X = L t and Z) = L X ([0,1],R). 
There exists a Lipschitz continuous mapping T : X — > 2) and a stopping time r with 
P(t > 0) = 1 suc/i taa£ t/ie stopped process 

(TXy t = (TX) tAT , te [0,1], 

is a Brownian motion stopped at time r. 
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Proof. Due to Lemma 0] there exists a function h G C°°(IR m ) with bounded derivatives 
that satisfies 

(16) (Vh)*bb*Vh = 1 

on a closed ball with radius r > around uq. Define the stopping time 

r = inf{t G [0, 1] : \X t -u \ = r}. 

Clearly, P(r > 0) = 1. 

In both cases cases, X = C and X = L\ we define a Lipschitz continuous mapping 
T : X -> 2) by 



(Tx)(t) = - % ) 

Ito's formula implies 



/ ^Vhra + ^J2( bb %^h)(x(s))ds. 

i,f=l 



(TX) 4 = / ((Vh)*b)(X t )dW t . 
Jo 



Observing we conclude that the stopped process (TX) T is a continuous martingale 
with quadratic variation 

ptAT 

((TX) T ) t = / ((Vh)*bb*Vh){X s )ds = tAT, 
Jo 

which completes the proof. □ 

Remark 6. The assumption that the diffusion coefficient b is of class C°° in a neighbor- 
hood of the initial value Uq can be relaxed. For instance, in the one-dimensional case it 
suffices to assume b £ C 1 ([0, 1]) with Lipschitz continuous first derivative. Then 



f(u)= / |l/6(t;)|d«; 

is well defined in a neighborhood of uq, and the statement of Lemma El follows with the 
same proof. 

4.2. Proof of Proposition O We use the contraction principle from LemmaElto estab- 
lish the upper bound for the Kolmogorov widths. 

Lemma 6. For every p > 

Proof. Assume that p > 1 without loss of generality. Fix k G N, put tf = £/k for i = 
0, . . . , k, and consider the corresponding Euler process X defined by X = u and 

X ( t k) = X^ + a(Xlf) • (t - t e ) + b(X^) ■ (W t - W tl ) 
for t G [U, U + x\. We have 

E\\x -X^W^ r< k~ p / 2 , 

see Bouleau, Lepingle (1994, p. 276), and therefore 

4\x,c)ik- 1 / 2 + 4 ) (x {k) ,c). 
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Let denote the piecewise linear interpolation of the Brownian motion W at the 
breakpoints tg and define the continuous process V {k) by 

v} k) = b(x ( ^)-(w t -wi k) ) 

for t G [tg, tg + i\. Note that — takes values in the (k + 1) -dimensional subspace of 
piecewise linear functions with breakpoints tg. Hence 

^Ux {k \c)<dt\v^\c). 

OA 

Let 21 denote the cx-algebra generated by W(ti), . . . , W{t k ). The random variables b(X t ) 

are measurable with respect to 21, and conditioned on 21 the process W — consists 
of independent Brownian bridges on the subintervals [t^, t^+i] . We apply Lemma El with 
X t = l [tt _ utt] ■ (W - W^) to obtain 

dg(V« C) < (E||6(X (fc) )f 00 ) 1/p -4 ) (H/-^,L7) < d<*\w,C). 

From Maiorov (1993) we get d%\W, C) x k~ 1/2 . □ 

The lower bound for the quantization numbers even holds for the space X = L\. 

Lemma 7. For every r > 

gW^.LOhClnn)- 1 / 2 . 
Proof. Observe that, due to Lemma ^ and Lemma it suffices to show that 

(17) g^LOMlnn)- 1 / 2 
for every one-dimensional process Y such that 

Y tAr = W tAr , te[o,i], 

with a stopping time r that satisfies P{r = 0) = 0. 

To this end fix e G ]0, 1] with P(r > e) > and define a bounded linear operator 
T : Li -> Li by 

(Tz)(i) = e~ 1/2 -x(e-t). 

Clearly TW is a Brownian motion, too. The quantization problem for Gaussian processes 
in the space L 1 is analyzed in Dereich, Scheutzow (2005). In particular there exists a 
constant k > such that 

(18) lim (Inn) 1/2 • q^iTW, L x ) = re 

n^oo 

for every r > 0, see Dereich, Scheutzow (2005, Thm. 6.1). 

For n G N let M n C L\ denote any set of cardinality n, fix 5 G ]0, 1[, and put 

A n = {dist(TW,M n ) > (1 - 6) ■ q^iTW,^)}. 
Due to (|TS|) we can complement the sets M n to sets M n of cardinality 2n such that 

lim (lnn) 1/2 ■ (E(dist 2r (TW,M n ))Y /2r = re. 

n— >oo 

as well as 

lim (lnn) 1/2 ■ (E(dist r (TH/,M„))) 1/r = re. 
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Employing Lemma A.l in Dereich, Scheutzow (2005) we conclude that 

lim F(A n ) = 1. 

n— *oo 

Consequently 

E(dist r (TF, M n )) > E(l {r > £} ■ disf (TW, M n )) 

> (1 - 5) r ■ P({r > e} n An) ■ {qP(TW, 
h (lnn)- r / 2 , 

which yields 

^(TF^O^ann)- 1 / 2 . 
The latter bound implies (jl7j) by Lemma 

Proof of Proposition In view of Lemma |H1 and Lemma [7| it suffices to show that 

(19) <£\X,C)±Qnn)- 1 ' 2 
and 

(20) df^Ljyk- 1 ' 2 . 
By Lemma El and Lemma El we have 



In n ■ (X, C) r< sup jfc • df C 7 ) ^ (In ^ 1/2 

fc<21nn 



which yields f!19|) . From Lemma |H1 we also get 

(21) dP(X,Lt) <c-k- 1 ' 2 

with some constant c > 0. Moreover, by Lemma 

sup Inn ■ g^pT,^) b sup(lnn) 1 / 2 ^ f 1 / 2 . 

Consequently, by Lemma |2 

sup k-d^ix,^) >c-e 1/2 

k<£ 

with some constant c G ]0, c[. Put c = (c/c) 2 . Since 



sup k-df'iX,^) <c-£ 1/2 

k<ci 



by (|2*T|) . we conclude that 



(fi^X,^)^ sup k-d*\x,L^>c.l x l*, 

c-i<k<l 



which yields (jUP . 



Remark 7. According to Lemma and (|20jl. Proposition El is valid, too, for X 
instead of X = C. 
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4.3. Proof of Proposition Consider a one-dimensional Brownian motion W. Given 
£ eN and e G ]0, 1] let = i/£- e and put 

B% = {xE C([0, 1]) : - x(a ( _!) > e 1 / 2 /^ 2 } 

as well as 

= {x G C([0, 1]) : x( Si ) - x(s^) < -e 1 ' 2 /^ 2 } 
for i = 1, . . . , i. Moreover, define 



A? = f]{W e B&} 



i=i 



for any multi-index a G {0, l} 1 . 

Lemma 8. There exists a constant Co G ]0, 1[ such that 

c • 7T l < F(A e a £ ) < 2~ e 
for allieN, e G ]0, 1], and a G {0, 1} £ . 

Proof. Obviously, the probability F(A e ^ £ ) does not depend on a. Hence 
F{W G Bf £ ) = | - P(0 < W Si - W Si _, < e 1 ' 2 /^ 2 ) 



2 

1/t 

(27r)- 1/2 exp(-x 2 /2)rfx 



^•(l-^A-r 1 ) 

implies 

2^-p(^/) > (l- v^A-r 1 )'. 

The latter bound tends to exp(— a/2/7t) as £ tends to infinity, which completes the proof. 

□ 

Let A be any event with F(A) > 1 — cq/2 and put 

N{e,i) = #{a G {0, 1}" : P(A £ / n A) > c • 2" £ - 2 }. 
Lemma 9. For all e > and £ G N 

N(e,£) > ci -2 £ , 

where c\ = c /(4 — c ). 
Proof. Due to Lemma |H1 

pf |J nAj> P(A) + pf |J A e A - 1 

> P(A) + c - 1 > c /2. 
On the other hand, by the definition of N(e,£) and Lemma |H1 

p( |J A e f n A J < (2* - N(e,*)) • c • 2^" 2 + N(e,£) ■ 2~ l . 
It remains to combine both estimates. □ 
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Proof of Proposition ^| Because of Lemma ^ and Lemma [5] it suffices to prove that 

(22) e™ n {Y, C) h n" 1 ' 2 ■ (lnn)- 3/2 

for every one-dimensional process Y such that 

Y tAT = W tAT , te[0,l}, 

with a stopping time r that satisfies P{t = 0) = 0. To this end we use Proposition [T] 
Put 

i=l 

and define f l a G F by 

f a (x)=dist(x,(B e a ) c ) 

for a G {0, l} 1 . Note that 

f a {x) > \ • min \x(si) - x(s<_i)| 
for xe B £ a . Choose e G ]0, 1] with P(r > e) > 1 - c /2, and let A = {r > e}. Then 
S'C/f) > \ ■ e(i a ■ l Bi (W) ■ .min \W Si - Ws^l) 

\ i=l, / 

Take n = \c\ • 2 l ~ 1 \ and use Lemma El to conclude that 

S(f a ) h n' 1 ■ (Inn)- 3 / 2 
holds uniformly for at least 2n multi-indices a G {0, 1}^. Finally, apply Proposition ^ to 



complete the proof of (|22j) . □ 

5. Randomized Algorithms for Gaussian Measures 

In this section we consider zero mean Gaussian measures \i on separable Banach spaces 
X, and throughout we assume that the corresponding small ball function 

cp(e) = — ln/x({x G X : ||x|| < e}) 

satisfies 

(23) ip{e) x £ - Q - (\ne-y 

for some constants a > and /3 G R as e tends to zero. 

Remark 8. Typically, (}2*3*|) holds for infinite-dimensional spaces X, see Li, Shao (2001). 
For example, if /i is the distribution of a fractional Brownian motion with Hurst parameter 
H G ]0, 1[ on X = C([0, 1]) or X = L p ([0, 1]) for some p G [1, oof, then a = 1/H and (3 = 0.. 
Moreover, a = 1/(H — 7) and (5 = when || • || denotes the 7-Holder norm. Similar results 
are known for Sobolev norms, see Kuelbs, Li, Shao (1995) and Li, Shao (1999). 

If X = C([0, l] 2 ) and // is the distribution of the two-dimensional fractional Brownian 
sheet, then a = 1/H and /3 = 1 + 1/H due to Belinsky, Linde (2002). Moreover, for a d- 
dimensional Brownian sheet considered in X = L 2 ([0, l} d ) one has a = 2 and (3 = 2(d — l), 
see Csaki (1984) and Fill, Torcaso (2004). 
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Assumption (|23|) determines the asymptotic behavior of the quantization numbers and 
the Kolmogorov widths, see Dereich (2003, Thm. 3.1.2) and Creutzig (2002, Cor. 4.7.2). 

Proposition 5. The quantization numbers q^ satisfy 

q^ x (lnn)- 1/a ■ (In In n)^ 01 

for every r > 0. The average Kolmogorov widths d^ satisfy 

dP~k- 1/a -{\nkf /a 

for every p > 0. 

Hence, by Theorem quadrature of arbitrary Lipschitz functionals by means of deter- 
ministic algorithms is intractable. Now we turn to the analysis of randomized algorithms. 

Proposition 6. The minimal errors e^ an satisfy 

limsup < an • n 1/2 ■ (\nn) 1+1/a ■ (lnlnn)"^ > 0. 

Proof. Apply Corollary El with / given by f(t) = c-(\nt)- l ' a ■ (lnlnt)^ for t sufficiently 
large and a suitable constant c > 0. □ 

PropositionlHlprovides a lower bound for the error of broad sense randomized algorithms 
in terms of the number of functional evaluations. The lower bound depends on the specific 
properties of the Gaussian measure only via logarithmic terms. This is no longer the case 
if we relate the error of randomized algorithms to their computational cost. 

Theorem 6. The minimal errors e r ^ n satisfy 

limsup ST ■ jVV(2+«) ■ ( lnA T)(2+2 Q -^)/(a(2+a)) . ^ ^ Ar) -2^/(a(2+a)) > Q 

Proof. We combine Propositions EJ EJ and|Hl Due to Proposition H there exists a constant 
c > and an increasing sequence of integers n# e N such that 

e™ n > c • n~ l/2 ■ (Inn*) -1-1 / ■ (lnlnn^ 

for every I G N. Put 

N t = [nf +a)/2 ■ (lnn,) a+/3+1 ■ (lnlnn,)-' 3 ], 
and let n, k e N with n ■ k < Ne. If n > m then k < Ne/ne, and Proposition El implies 
(24) d k > d [Ne/nei y (Nt/m)- 1 '" ■ (ln(N e /n e ) f a x nj 1/2 ■ (Inn,)- 1 " 1 / ■ (luffing. 
On the other hand, if n < ne then e™ n > e™ n . Consequently, by Proposition El and (|24j) 

h nj 1/2 ■ (Inn,)" 1 - 1 /" • (lnlnn^. 
Straightforward computations show 

X AT-V(2+«) . ( ln ^)-(2+2a- Q /3)/( a (2 +Q) ) . ^ ^ ^ 20/(a(2+a)) ? 

which completes the proof. □ 
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It is quite common to approximately compute the integrals S(f) with respect to 
Gaussian measures by sampling from a standard normal distribution on a suitable finite- 
dimensional subspace of X. A proper choice of the subspace is suggested by the following 
general result on average linear widths, which is due to Creutzig (2002, Thm. 4.4.1). There 
exist points x% G X and bounded linear functional ^ G X* such that 

(25) (I \\x - X { - k \x)f ^{dx)\ ±\nk-d k 



for 

x^(x) = x:ef ) (x)-xf. 

e=i 

Clearly we may assume that £^ , . . . , £^ are independent with respect to jj. Take inde- 
pendent copies x[ k \ . . . Xn of X^ and define the randomized algorithm Sn^ by (jl3j) . 

Theorem 7. The algorithm S N = S { n k) with n = [iV 2/(2+Q) ■ (In j\r)-2(a+/3)/(2+a)j and 

k = [N a /^ ■ (lnAT)2(a+/3)/(2+a)j saUs fi es 

e(S N ) d iV- 1/(2+a) • (lniV) (Q+/3)/(2+Q) 

and 

cost(SV) r< X. 

Proof. Proceed as in the proof of Theorem El to obtain 

e 2 (S k n ) ■< l/n+(\nk) 2 ■ d\ ■< l/n + k- 2 ' a ■ (\nk) 2( - a+ ^ a 

by means of (|2*K|) and Proposition 03 The asymptotic upper bound for the error of SV = 
Sn now follows from the particular choice of n and k. Clearly, cost^i^) x k ■ n. □ 

Combine Theorems El and U\ to conclude that the algorithm Sn is almost optimal in the 
following sense. 

Corollary 4. There exists a constant c > such that 

e(S N ) <c-eT- (In A0 1+2/(Q{2+Q)) • (lnln A0" 2/3/(a(2+a)) 
holds for infinitely many integers N . 

Remark 9. A slightly better upper bound is available if the Banach space X is B-convex, 
e.g., if X is an L p -space with p G ]1, oof. Instead of (|23|) we then have 

(26) ( f \\x - X^ k \x)\\ 2 n(dx)) ' ^4, 



see Creutzig (2002, Cor. 3.4.2), which yields 

e(S N ) ± N- 1 /^ ■ (\nN)W +a *> 

in Theorem [3 Both of the estimates (|25|) and ()26|) are proven non-constuctively. 

For a number of Gaussian measures on function spaces the Karhunen-Loeve expansion 
is explicitly known, and hereby we get an approximation that satisfies (|26|). if X is 
any L p -space with p G ]1, oo[. In particular for an L 2 -space X and (3 = the upper bound 
is due to Wasilkowski, Wozniakowski (1996, p. 2076). 
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Consider the distribution /1 of the <i-dimensional fractional Brownian sheet with Hurst 
parameter H e ]0, 1[ on the space X = C([0, l] d ). In this case a direct approach yields 

(27) ( [ \\x - X^ k \x)\\ 2 fiidx))^ 2 ^ k~ H ■ (\nk) H ^ +d / 2 , 



see Kiihn, Linde (2002). See also Ayache, Taqqu (2003) for a wavelet approximation X^ 
in the case d = 1 and Dzhaparidze, van Zanten (2005) for a trigonometric approximation 
in the case d > 1, which both satisfy this estimate. From (|27j) we get 

in Theorem [3 
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